---
title: Cohere
sidebarTitle: Cohere
---

The Cohere model provides access to Cohere's language models.

## Parameters

| Parameter                       | Type                          | Default                        | Description                                                                                   |
| ------------------------------- | ----------------------------- | ------------------------------ | --------------------------------------------------------------------------------------------- |
| `id`                            | `str`                         | `"command-r-plus-08-2024"`     | The id of the Cohere model to use                                                            |
| `name`                          | `str`                         | `"CohereChat"`                 | The name of the model                                                                         |
| `provider`                      | `str`                         | `"Cohere"`                     | The provider of the model                                                                     |
| `api_key`                       | `Optional[str]`               | `None`                         | The API key for Cohere (defaults to COHERE_API_KEY env var)                                  |
| `max_tokens`                    | `Optional[int]`               | `None`                         | Maximum number of tokens to generate                                                          |
| `temperature`                   | `Optional[float]`             | `None`                         | Controls randomness in the model's output (0.0 to 1.0)                                      |
| `p`                             | `Optional[float]`             | `None`                         | Controls diversity via nucleus sampling (0.0 to 1.0)                                        |
| `k`                             | `Optional[int]`               | `None`                         | Controls diversity via top-k sampling                                                        |
| `seed`                          | `Optional[int]`               | `None`                         | Random seed for deterministic sampling                                                        |
| `frequency_penalty`             | `Optional[float]`             | `None`                         | Reduces repetition by penalizing frequent tokens (0.0 to 1.0)                               |
| `presence_penalty`              | `Optional[float]`             | `None`                         | Reduces repetition by penalizing present tokens (0.0 to 1.0)                                |
| `stop_sequences`                | `Optional[List[str]]`         | `None`                         | List of strings that stop generation                                                          |
| `response_format`               | `Optional[Dict[str, Any]]`    | `None`                         | Specifies the format of the response (e.g., JSON)                                            |
| `citation_options`              | `Optional[Dict[str, Any]]`    | `None`                         | Options for citation generation                                                               |
| `request_params`                | `Optional[Dict[str, Any]]`    | `None`                         | Additional parameters to include in the request                                               |
| `client_params`                 | `Optional[Dict[str, Any]]`    | `None`                         | Additional parameters for client configuration                                                |